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Introduction 


*  AFRL  manages  the  Defense  Modeling  and  Simulation 
Office  (DMSO)  Human  Performance  program 

*  Today  I  will  provide  an  overview  of: 

—  Crowd  modeling 

—  Rules  of  engagement  simulation 
—  Non-lethal  weapons  modeling 
—  Cultural  modeling  testbed 
—  Recently  transition  projects 
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These  are  the  topics  I  will  be  covering  today: 

Crowd  modeling 
Rules  of  engagement  simulation 
Non-lethal  weapons  modeling 
Cultural  modeling  testbed 
Recently  transition  projects 


Prime  Contractor:  Virginia  Modeling,  Analysis,  and  Simulation  Center 


Project  Definition 

—  Develop  and  demonstrate  a  culturally  variable  crowd  federate  that  can 
interoperate  with  existing  military  simulations 

Specific  Technology 

—  Crowd  conceptual  models 

—  Crowd  federate  that  interacts  with  JSAF  and  OneSAF  I 

—  Behavioral  moderators  for  crowds 
Users  and  Sponsors 

—  Air  Force  Research  Lab 

—  Defense  Modeling  and  Simulation  Office 

—  Joint  Forces  Command 

—  Joint  Non-Lethal  Weapons  Directorate  \  f*: 

—  Army  Maneuver  Support  Battlelab 

V  AA  A 
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The  Prime  contractor  is  VMASC 


The  goal  of  the  effort  is  to: 

Develop  and  demonstrate  a  culturally  variable  crowd  federate 
that  can  interoperate  with  existing  military  simulations 

Specific  Technology  that  is  being  developed  includes 

Crowd  conceptual  models 

Crowd  federate  that  interacts  with  JSAF  and  OneSAF 
Behavioral  moderators  for  crowds 
Users  and  Sponsors 

Air  Force  Research  Lab 

Defense  Modeling  and  Simulation  Office 

Joint  Forces  Command 

Joint  Non-Lethal  Weapons  Directorate 

Army  Maneuver  Support  Battlelab 
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The  Motivation  of  the  effort  was  to: 

Understand  crowd  behavior  in  military  scenarios 
Provide  psychological  basis  for  cognitive  model 
Methods  that  were  employed  include 
Interviews  and  surveys 
Behavior  coding  from  crowd  event  video 
Observe  military  crowd  control  training 
Literature  review 

Status 

Project  specific  information  gained 
More  study  needed  to  provide  firm  basis 


Crowd  Federate 

Architecture 


*  Modular  architecture 

—  Cognitive  model 
—  Crowd  behavior  API 
—  Physical  model 
—  Network  interface 


•  Software 

—  Programmed  in  C++ 

—  Uses  some  commercial  software  components 


,  „  _  , ,  r*-»  — - 
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Cognitive  model 

Crowd  behavior  API 

Network  interface  U 

Physical  model 

nr 

SAF 
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A  key  product  of  the  effort  was  a  modular  architecture  that  allows  different 
models  to  be  incorporated  into  a  simulation 


The  software  was  programmed  in  C++ 


Crowd  Federate 

Crowd  Parameters 


•  Mood 

•  Size 

•  Propensity  for  violence 

•  Demographics 

•  Leadership  structure 

•  Presence  of  Local  Police  Force 

•  Ability  to  negotiate 

•  Terrain 

UNCLASSIFIED  Integrity  -  Service  -  Excellence 


Some  of  the  parameters  that  were  modeled  include: 

Mood 

Size 

Propensity  for  violence 

Demographics 

Leadership  structure 

Presence  of  Local  Police  Force 

Ability  to  negotiate 

Terrain 


Crowd  Federate 

Implementation  Tables 


*  Maintain  flexibility 

*  3  Tables  for  configuration 

—  Crowd  Parameter  x  Crowd  Parameter 
—  Stimuli  x  Aggression  Level 
—  Aggression  Level  x  Behavior 

*  Certain  combinations  of  factors  will  result  in  an 
increase  or  decrease  of  the  crowds  aggression  level 

*  Configuration  tables  can  be  representative  of 
differing  cultures  or  population  groups 


UNCLASSIFIED  Integrity  -  Service  -  Excellence 


The  behavior  is  controlled  through  implementation  tables,  of  which  there  are 
three: 

3  Tables  for  configuration 

Crowd  Parameter  x  Crowd  Parameter 
Stimuli  x  Aggression  Level 
Aggression  Level  x  Behavior 

Certain  combinations  of  factors  will  result  in  an  increase  or  decrease  of  the 
crowds  aggression  level 

Configuration  tables  can  be  representative  of  differing  cultures  or  population 
groups 
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Crowd  Federate 

Crowd  Parameter  x  Crowd  Parameter 


Terrain. 

Terrain. 

CrowdSize. 

CrowdSize. 

CrowdSize. 

Mood,  i  Mood.  1  Mood. 

Steep 

Flat 

Small 

Med 

Big 

Neutral  Avoidance 

Mood. 

Neutral 

0 

0 

0 

0 

0 

Mood. 

Avoidanoe 

-1 

-1 

-1 

-1 

-1 

Mood. 

Curious 

-1 

1 

-1 

-1 

-1 

Mood. 

Aggressive 

Posture 

1 

1 

1 

1 

1 

Mood. 

Aggressive 

Non-Lethal 

1 

1 

1 

1 

1 

Mood. 

Aggressive 

Lethal 

1 

1 

1 

1 

1 

UNCLASSIFIED 
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Here  is  the  first  table 


Table  two. 
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Crowd  Federate 

Aggression  Level  x  Behavior  (1  of  2) 


Agression  Level 

Behavior 

Agitator 

Protestor 

Casual 

Bystander 

Avoidance 

Fleeing  from 

20 

20 

25 

27 

Cro*  d  retreating 

20 

17 

20 

22 

hiding 

10 

25 

10 

0 

Scattering 

30 

25 

20 

22 

Dispersing 

30 

18 

25 

29 

Neutral 

Standing  around  individually 

40 

60 

40 

50 

Observers  not  participating 

60 

40 

60 

50 

Curious 

Hanging  out/  w  afching 

0 

20 

20 

40 

Climbing  elevated  structires 

0 

40 

20 

10 

Wandering 

0 

20 

40 

10 

Staring  at 

0 

20 

20 

40 

LowAggressive 

Flag  waving 

20 

30 

40 

0 

Standing  on  elevated  stricture 

20 

30 

40 

0 

Seeking  to 

40 

30 

20 

0 

Carrying  weapon  on  shoulder 

20 

10 

0 

0 

MedAgyessive 

Chanting 

25 

30 

36 

0 

Waving  signs  and  banners 

18 

17 

23 

0 

Seeking  to 

13 

12 

12 

0 

Overturning  dumpsters 

13 

12 

12 

0 

Carrying  weapon  in- hand 

18 

12 

0 

0 

Marching 

13 

17 

17 

0 
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Table  three. 


Crowd  Federate  Jilt 

Aggression  Level  x  Behavior  (2  of  2) 


Aggression  Laval 

Behavior 

Agitator 

Protestor 

Casual 

Bystander 

HghAggressive 

Cursing/yelfing 

15 

16 

17 

0 

Obscene  hand  gestires 

15 

16 

17 

0 

Swarm  to 

15 

15 

15 

0 

Looting 

15 

16 

17 

0 

Taunting 

15 

16 

17 

0 

Brandishing  weapon 

10 

5 

0 

0 

Rcking  up  projectiles 

15 

16 

17 

0 

NonLeth  al  LessVb  ie  nt 

Rishing 

27 

28 

30 

0 

Rjnching 

27 

28 

30 

0 

Burning  objects 

19 

16 

12 

0 

Throwing  objects 

27 

28 

28 

0 

Non  Le  th  aW  oreV  tote  nt 

Throwing  pepper  gas  cans 

30 

40 

15 

0 

Gang  beating  (fighting) 

25 

25 

35 

0 

Looting 

25 

25 

35 

0 

Shooting  in  air 

20 

10 

15 

0 

Lethal  Action 

Shooting  at 

40 

33 

0 

0 

Throwing  Molotov  cocktail 

14 

15 

0 

0 

Throwing  Grenade 

Shooting  Technicos  gun- 

18 

22 

0 

0 

mounted  pickups 

10 

10 

0 

0 

RPG 

18 

20 

0 

0 
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This  table  depicts  some  of  the  interactions  between  the  various  factors. 


Crowd  Federate 

Army  Maneuver  Support  Battlelab 


*  Maneuver  Enhancement  Brigade  Study  1  (Jun  05) 

-  Establish,  Secure  &  Maintain  Ground  LOCs 

—  OneSAF  OTB  used  for  core  synthetic  environment 
—  Network  Communications  via  DIS 

—  MP  personnel  used  as  “pucksters”  to  control  Army  and  OpFor 

*  Crowd  Federate  Participation 

—  Communications  achieved  using  JSAF  HLA/DIS  gateway 

—  Provided  key  capabilities  previously  unavailable 

—  First  experience  very  positive,  future  collaboration  is 
underway 

—  AMSBL  is  now  an  advocate  of  the  Crowd  Federate 

UNCLASSIFIED  Integrity  -  Service  -  Excellence  El^mSiNp 


The  crowd  federate  has  been  demonstrated  at  the  Army  Maneuver  Support 
Battle  Lab 


Crowd  Federate 

Joint  Forces  Command 


Multinational  Experiment  4  (MNE  4) 


—  Refine  and  assess  processes,  organizations  and  technology 
to  support  Coalition  and  NATO  Response  Force  with  regards 
toEBO 

—  Participants:  Australia,  Canada,  Finland,  France,  Germany, 
Sweden,  United  Kingdom,  NATO 

—  Execution:  20  Feb  -  17  Mar  06 

Crowd  Federate  Participation 

—  Selected  to  play  complementary  role  to  SEAS  (Synthetic 
Environment  for  Analysis  and  Simulation) 

■  SEAS  will  monitor  and  control  overall  population 

■  Crowd  Federate  will  control  “temporal”  crowds  created  by  SEAS 

—  Communications  over  HLA 
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There  are  plans  to  incorporate  the  crowd  federate  into  a  JFCOM  exercise.  In 
this  exercise  it  will  interact  with  another  simulation. 


Crowd  Federate 

Summary 


Successes 

—  Movement  from  demonstration  to  participation 

—  Initial  transition  underway 

■  Additional  support  for  the  AMBSL  planned  with  FY05  funds 

■  JFCOM  is  bringing  the  Crowd  Federate  into  the  ATT 

■  JFCOM  will  use  the  Crowd  Federate  in  upcoming  NATO  experiment 

More  work  to  be  done 

—  Crowd/group  &  Individual  level  parameter  understanding  & 
validation 

—  Psychological  model  refinement 
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In  summary... 


Movement  from  demonstration  to  participation 
Initial  transition  underway 

Additional  support  for  the  AMBSL  planned  with  FY05  funds 
JFCOM  is  bringing  the  Crowd  Federate  into  the  ATT 

JFCOM  will  use  the  Crowd  Federate  in  upcoming  NATO 
experiment 

More  work  to  be  done 

Crowd/group  &  Individual  level  parameter  understanding  &  validation 
Psychological  model  refinement 


Rules  of  Engagement  Evaluation 
Environment  (R0E3) 


*  Prime  Contractor:  Agent  Oriented  Software 


•  Project  Definition 

—  Create  tools  for  investigating  the  employment 
and  effects  of  Rules  of  Engagement  (ROE) 

•  Specific  Technology 

—  Human  behavior  modeling  environment  for  modeling  ROEs 
—  Framework  and  software  tools  for  defining  ROEs,  tactics,  behavior 
models  and  moderators 

—  Cognitive  architecture  that  incorporates  behavior  moderators 

•  Users  and  Sponsors 
—  Air  Force  Research  Lab 
—  Defense  Modeling  and  Simulation  Office 
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Project  Definition 

Create  tools  for  investigating  the  employment 
and  effects  of  Rules  of  Engagement  (ROE) 

Specific  Technology 

Human  behavior  modeling  environment  for  modeling  ROEs 
Framework  and  software  tools  for  defining  ROEs,  tactics,  behavior 
models  and  moderators 

Cognitive  architecture  that  incorporates  behavior  moderators 
Users  and  Sponsors 

Air  Force  Research  Lab 

Defense  Modeling  and  Simulation  Office 


4  i  Rules  of  Engagement  Evaluation 
yg'  Environment  (R0E3) 


PRODUCT: 

•  Human  behavior  modeling  environment  for  modeling 
ROEs 

•  Framework  and  software  tools  for  defining  ROEs,  tactics, 
behavior  models  and  moderators 

•  Cognitive  architecture  that  allows  the  invariant  properties 
of  human  cognition  to  be  configured  across  behavior 
models 

IMPACT: 

•  ROEs  can  be  systematically  evaluated  for  effectiveness, 
clarity,  unforeseen  implications,  and  reliability 

•  Standardization  of  ROE  formalization,  thus  reducing  the 
cost  and  time  to  evaluate  changes  to  ROEs 
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PRODUCT: 

Human  behavior  modeling  environment  for  modeling  ROEs 
Framework  and  software  tools  for  defining  ROEs,  tactics,  behavior 
models  and  moderators 

Cognitive  architecture  that  allows  the  invariant  properties  of  human 
cognition  to  be  configured  across  behavior  models 

IMPACT: 

ROEs  can  be  systematically  evaluated  for  effectiveness,  clarity, 
unforeseen  implications,  and  reliability 

Standardization  of  ROE  formalization,  thus  reducing  the  cost  and  time  to 
evaluate  changes  to  ROEs 


Rules  of  Engagement  Evaluation 
Environment  (ROE3) 


*  Accomplishments 

—  OneSAF  0TB2  selected  and  obtained  for  simulation 
environment 

—  Convoy  roadblock  scenario  with  variations  developed  from 
SME  and  ROE  Handbook 


—  Specification  Document  submitted  by  contractors  (AOS) 


—  Initial  integration  between  cognitive  architecture  (Co-Jack) 
and  simulation  environment  (OneSAF)  conducted 


—  Summary:  Solid  technical 
groundwork  established 
and  core  developmental 
work  is  underway 
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Accomplishments 

OneSAF  OTB2  selected  and  obtained  for  simulation  environment 

Convoy  roadblock  scenario  with  variations  developed  from  SME  and 
ROE  Handbook 

Specification  Document  submitted  by  contractors  (AOS) 

Initial  integration  between  cognitive  architecture  (Co-Jack)  and 
simulation  environment  (OneSAF)  conducted 


Summary:  Solid  technical  groundwork  established  and  core 
developmental  work  is  underway 


Rules  of  Engagement  Evaluation 
Environment  (ROE3) 


Future  Developments 

—  Further  define  possible  ROE3  uses: 

■  ROE  framework  for  DARWARS  Ambush!  trainer 

■  ROE  evaluation  and  demonstration  tool  for  theater  commanders 

■  ROE  framework  for  Fixed-Site  Facility  Defense  Testbed 

—  Continue  to  coordinate  with  JFCOM  and  JNLWD  to  develop  user  needs 
and  feedback 

Proof  of  Concept  demonstration  goals  (Q3  FY05) 

—  Show  the  feasibility  of  modeling  ROE  in  a  simulation  environment 

—  Affect  realistic/expected  change  in  scenario  resolution  through  the 
implementation  of  ROE 

■  Secondary  goal:  demonstrate  impact  of  behavior  moderators  on  ROE  and 
outcome 

—  Generate  support  for  implementation  effort 
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Potential  future  developments  include: 

Further  define  possible  ROE3  uses: 

ROE  framework  for  DARWARS  Ambush!  trainer 

ROE  evaluation  and  demonstration  tool  for  theater  commanders 

ROE  framework  for  Fixed-Site  Facility  Defense  Testbed 

Continue  to  coordinate  with  JFCOM  and  JNLWD  to  develop  user  needs 
and  feedback 

Proof  of  Concept  demonstration  goals  (Q3  FY05) 

Show  the  feasibility  of  modeling  ROE  in  a  simulation  environment 

Affect  realistic/expected  change  in  scenario  resolution  through  the 
implementation  of  ROE 

Secondary  goal:  demonstrate  impact  of  behavior  moderators  on 
ROE  and  outcome 

Generate  support  for  implementation  effort 


Rules  of  Engagement  Evaluation 
Environment  (ROE3) 

.  . 


*  Possible  implementation  actions 


—  Provide  Ul  control  to  allow  users  to  test,  evaluate, 
and  demonstrate  different  ROE  under  various 
circumstances 


■  ROE  -  Provide  sets  of  ROE  and  a  ROE  construction  tool 

■  Scenario  -  Select  location  and  event 

■  Personnel  -  Friendly  and  opposition  forces 

—  Develop  knowledge  base 
and  library  of  locations, 

ROE  sets,  and  scenarios 
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Possible  implementation  actions 

Provide  Ul  control  to  allow  users  to  test,  evaluate,  and 
demonstrate  different  ROE  under  various  circumstances 

ROE  -  Provide  sets  of  ROE  and  a  ROE  construction 
tool 

Scenario  -  Select  location  and  event 
Personnel  -  Friendly  and  opposition  forces 

Develop  knowledge  base 
and  library  of  locations, 

ROE  sets,  and  scenarios 


Non-Lethal  Weapon  Models 


Prime  Contractor 

—  Micro  Analysis  &  Design 


Project  Definition 

—  Develop  Non-Lethal  Weapons  libraries 7or  use  in  JSAF  and  OneSAF 


•  Specific  Technology 

—  Non-Lethal  Weapon  libraries  in  JSAF  and  OneSAF 


*  Users  and  Sponsors 
—  Air  Force  Research  Lab 
—  Defense  Modeling  and  Simulation  Office 
—  Joint  Non-Lethal  Weapons  Directorate 
—  Crowd  Federate  and  ROE3  Micro  Analysis  &  Design 

UNCLASSIFIED  Integrity  -  Service  -  Excellence 


Another  completed  effort  addressed  the  development  of  models  of  non-lethal 
weapons.  Specifically,  model  libraries  were  created  for  JSAF  and  OneSAF. 


Non-Lethal  Weapons  Models 

*  Issues  Dealt  With 

—  NLW  related  deficiencies  in  SAF 
—  Data  to  support  Control  Force  behaviors 


•  NLW  Libraries 

—  M203  (Grenade  launcher) 


■  Smoke  (yellow,  white,  red) 

■  Tear  gas  (CS) 

■  Fragmentary  grenade 

■  Sponge  round 

■  Crowd  dispersal  cartridge 

UNCLASSIFIED  Integrity  -  Service 


-  Ml 6,  M4  (Rifle) 

■  Metal  bullets 

■  Rubber  bullets 

■  Rubber  balls 
encased 

I 

-  M9  (Pistol)  9 

•  Metal  bulled 

-  ADS 

■  Energy 


>) 


Excellence 


Model  libraries  include: 

M203  (Grenade  launcher) 


Smoke  (yellow,  white,  red) 
Tear  gas  (CS) 
Fragmentary  grenade 
Sponge  round 
Crowd  dispersal  cartridge 
Rubber  balls 


Culture  and  Personality  Testbed  JjB* 

Overview 

•  Prime  Contractor:  BBN  Technologies 


•  Project  Definition 

—  Develop  research  testbed  using  commercial  game  technology,  Neverwinter 
Nights  TM,  to  quantify  the  role  of  personality  and  cultural  factors  in  military 
operations. 

•  Specific  Technology 

—  Algorithms  and  other  techniques  to  represent  socio-cultural  knowledge 
—  Quantitative  data  on  cultural  differences  in  military  operations 
—  C2  system  analysis  tools  and  methods 


*  Users  and  Sponsors 

—  Air  Force  Research  Lab 
—  Army  Research  Lab 
—  Defense  Modeling  and  Simulation  Office 
-  NATO 


BBN 

TECHNOLOGIES 


UNCLASSIFIED  Integrity  -  Service  -  Excellence 
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The  Culture  and  Personality  has  completed  the  initial  testbed. 


Funding  received  for  FY05  and  FY06  to  further  refine  the  testbed  and 
conduct  experiments. 


Initial  BBN  testing  will  compare  Americans  and  Chinese  (Boston  area 
students) 


The  testbed  is  receiving  a  range  of  interest,  test  cases  planned  for 
NATO  and  Korea,  also  several  graduate  study  programs  are  interested 


Culture  and  Personality  Testbed 

Problem  Statement 

- - - >~~v— - - : . •. . : 


•  Problem:  Military  operations  are  increasingly 
multinational  involving  partner  nations  with  diverse 
cultures 

—  Wing  Commander  &  Group  Captain 
—  Numbers,  commas  &  decimals:  2.000  =  ? 


*  Military  requires  a  better  understanding  of  coalition 
partners  for  smoother  operations 

•  Solution:  Increase  militarily  relevant  research  on  culture 
and  personality 

—  NATO  HFM  ET  049:  Coalition  team  work 


—  NATO  HFM  ET  056:  Cross-cultural  perspective  on  military 
culture 
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The  problem  we  are  addressing  is: 

Problem:  Military  operations  are  increasingly  multinational  involving 
partner  nations  with  diverse  cultures 

Wing  Commander  &  Group  Captain 

Numbers,  commas  &  decimals:  2.000  =  ? 

Military  requires  a  better  understanding  of  coalition  partners  for  smoother 
operations 


Culture  and  Personality  Testbed 

Vision 


•  Vision:  Develop  a  testbed  for  culture  &  personality 
research  based  on  a  commercial  game 

*  Testbed  Advantages 

—  Action/behavior  based  rather  than  hypothetical 
situations  or  self-reports 

■  New  paradigm  for  culture  research! 

—  Immersive  environment: 

■  True  self  can  emerge 
—  Replicability 
—  Easier  data  collection 


■  Decouple  researcher  &  subject 


■  Potentially  larger  subject  pool  available 
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Our  goal  is  to  Develop  a  testbed  for  culture  &  personality  research  based 
on  a  commercial  game 

The  advantages  are: 

Action/behavior  based  rather  than  hypothetical 
situations  or  self-reports 

New  paradigm  for  culture  research! 

Immersive  environment: 

True  self  can  emerge 

Replicability 

Easier  data  collection 

Decouple  researcher  &  subject 

Potentially  larger  subject  pool  available 


Culture  and  Personality  Testbed 


Testbed  Features 


Multi-player  format 

Reasonable  military  situation  portrayal 

Versatility  through  authorable  scenarios 

Hooks  to  facilitate  entity  control  by  Human  Behavior 
Model’s  (HBMs) 

Teammates/opponents  playable  by  humans  &  HBMs 
Automated  data  capture 

Multiple  mechanisms  for  data  collection: 

—  In-game  behaviors  as  well  as  out-of-game  surveys 


UNCLASSIFIED 


Integrity  -  Service  -  Excellence 
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Key  features  include: 

Multi-player  format 

Reasonable  military  situation  portrayal 
Versatility  through  authorable  scenarios 

Hooks  to  facilitate  entity  control  by  Human  Behavior  Model’s  (HBMs) 
Teammates/opponents  playable  by  humans  &  HBMs 
Automated  data  capture 
Multiple  mechanisms  for  data  collection: 

In-game  behaviors  as  well  as  out-of-game  surveys 


*  In-game  behaviors 

*  In-game  probes  (integrated  into  game  narrative  or  gameplay) 

—  questionnaires  in  guise  of  in-game  conversations 

—  write  a  memo 

—  etc 

*  Out-of-game  probes 

—  occurs  during  the  game,  but  not  disguised  as  part  of  the 
game 

*  Pre-  and  post-game  evaluation 
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Date  we  can  collect  include: 

In-game  behaviors 

In-game  probes  (integrated  into  game  narrative  or  gameplay) 

questionnaires  in  guise  of  in-game  conversations 

write  a  memo 

etc 

Out-of-game  probes 

occurs  during  the  game,  but  not  disguised  as  part  of  the  game 
Pre-  and  post-game  evaluation 


4,  jk  Culture  and  Personality  Testbed 

Decision  Quality 


Scenario  design  determines  which  choices  are  correct  &  defines 
how  much  information  will  be  available  to  players  to  guide 
choices 


Types  of  Decisions 

—  Shall  I  attack  or  negotiate? 

—  Which  way  will  I  go? 

—  Who  should  I  talk  to? 

—  Who  do  I  believe? 

—  What  equipment  will  I  use? 

—  Should  I  expend  a  resource  now  or  save  it  for  later? 
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The  types  of  decisions  the  players  have  to  make  include: 
Shall  I  attack  or  negotiate? 

Which  way  will  I  go? 

Who  should  I  talk  to? 

Who  do  I  believe? 

What  equipment  will  I  use? 

Should  I  expend  a  resource  now  or  save  it  for  later? 


*  NwN  has  many  recurring  tactical  situations  which  provide  rich  data 
potentially  useful  for  measuring  task  effectiveness 


*  Basic  recurring  tasks 

—  Combat 
—  Negotiation 
—  Trap  avoidance 
—  Resource  gathering 
—  Exploration 

*  Other  tasks  could  specifically  be  constructed  for  an  experiment 

—  Efficiency  in  monitoring  Al  participants,  team  members 
—  Strategies  chosen  for  team  exploration 
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NwN  has  many  recurring  tactical  situations  which  provide  rich  data  potentially 
useful  for  measuring  task  effectiveness 

Basic  recurring  tasks 
Combat 
Negotiation 
Trap  avoidance 
Resource  gathering 
Exploration 

Other  tasks  could  specifically  be  constructed  for  an  experiment 
Efficiency  in  monitoring  Al  participants,  team  members 
Strategies  chosen  for  team  exploration 


*  Place  explicit  time  limits  on  decisions 

—  “No  decision”  becomes  a  decision  after  a  certain  point 

*  Impose  time  limits  for  goals  to  be  achieved 

*  Write  scenarios  so  that  time  urgency  immerges  from 
the  scenario 

—  E.g.,  the  castle  is  falling  apart  so  we  need  to  leave  soon 

—  This  may  provoke  more  naturalistic  reactions  than  artificial 
deadlines 

—  This  type  of  situation  requires  an  immersive  environment 
that  works  well  in  NwN,  but  not  in  a  custom  testbed  solution 
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Place  explicit  time  limits  on  decisions 

“No  decision”  becomes  a  decision  after  a  certain  point 
Impose  time  limits  for  goals  to  be  achieved 
Write  scenarios  so  that  time  urgency  immerges  from  the  scenario 
E.g.,  the  castle  is  falling  apart  so  we  need  to  leave  soon 
This  may  provoke  more  naturalistic  reactions  than  artificial  deadlines 

This  type  of  situation  requires  an  immersive  environment  that  works 
well  in  NwN,  but  not  in  a  custom  testbed  solution 


*  Set  up  scenarios  with  options  for 

—  Spending  time  gathering  information 
—  Spend  time  planning 
—  Jumping  directly  into  the  situation 

*  Monitor  actions,  individual  &  team 

—  Negotiation,  exploration,  combat, 

—  Resource  gathering,  etc. 

*  Monitor  communication 

—  How  much,  who,  about,  etc 

*  Scenarios  can  be  fairly  linear  or  very  open  &  parallel 
allowing  extensive  experimenter  control  of  degree  of 
flexibility  given  to  participants. 

UNCLASSIFIED  Integrity  -  Service  -  Excellence 


The  way  to  measure  decision-making  is  to 

Set  up  scenarios  with  options  for 

Spending  time  gathering  information 
Spend  time  planning 
Jumping  directly  into  the  situation 
Monitor  actions,  individual  &  team 
Negotiation,  exploration,  combat, 

Resource  gathering,  etc. 

Monitor  communication 

How  much,  who,  about,  etc 

Scenarios  can  be  fairly  linear  or  very  open  &  parallel  allowing 
extensive  experimenter  control  of  degree  of  flexibility  given  to 
participants. 


Culture  and  Personality  Testbed 

How  to  Measure  Communication  Patterns 


*  Communication  mechanisms  provided  in  game 

*  NwN  virtual  world  constrains  communication:  only 
avatars  in  same  virtual  room  can  communicate 

*  Communication  difficulty  can  be  manipulated  using 
these  constraints 
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Communication  mechanisms  provided  in  game 

NwN  virtual  world  constrains  communication:  only  avatars  in  same 
virtual  room  can  communicate 

Communication  difficulty  can  be  manipulated  using  these 
constraints 


Culture  and  Personality  Testbed 

How  to  Measure  Situation  Assessment 


*  Can  interrupt  gameptay  to  assess  participant’s 
situation  awareness 

—  Goals,  current  actions,  threats,  beliefs,  etc 


*  Can  assess  through  nonplayer  avatars 

—  Which  may  provide  a  more  ecologically  valid  method  of 
assessment 
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Situation  assessment  can  be  measured  by 
Can  interrupt  gameplay  to  assess  participant’s  situation  awareness 
Goals,  current  actions,  threats,  beliefs,  etc 

Can  assess  through  nonplayer  avatars 

Which  may  provide  a  more  ecologically  valid  method  of  assessment 


Culture  and  Personality  Testbed 

Initial  Use  of  Testbed 
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NATO  Sponsors 
•Supreme  Allied  Command 
Transformation  Headquarters  (HQ  SACT): 
Concept  Development  &  Experimentation 
(CD&E)  project  “  Leader  and  Team 
Adaptability  in  Multinational  Coalitions: 
Cultural  Diversity  in  Cognition  and 
Teamwork” 

•Research  and  Technology  Organization 
(RTO)  Human  Factors  &  Medicine 
Exploratory  Team  49  (HFM  ET-049) 
project  “ Adaptability  in  Coalition 
Teamwork" 

POCs 

Dr.  Rik  Warren,  AFRL, 
Richard.Warren@wpafb.af.mll 

Dr.  Janet  Sutton,  ARL, 
janet.sutton@us.army.mil 

Mr.  Van  Edelmann,  HQ  SACT, 
edelmann@saclant.nato.int 


_  International  Research  Team  _ 

•FOCUS:  Improving  team  adaptability  in 
multi -cultural  military  staff  environments 

•EFFORT: 

•Establish  national  &  NATO  testbeds 

♦Identify  system  design  requirements 
for  collaborative  tools,  decision  aids,  & 
training 

♦Develop  methods  for  experimentation 

♦Develop  conceptual  model  of  cultural 
adaptability  for  military  operations 
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Sponsors  include: 


Work  Completed  in  FY04 

*  Improved  fidelity  and  accuracy  of  behavior  models  used  in  Joint 
Warfare  Simulation  (JWARS) 

—  Commander  Behavior  Modeling  for  Command  and  Control 
(CBMC2)  created  more  realistic  decision  models  for  three 
levels  of  command  in  JWARS  (Incorporated  into  JWARS  1.6) 


*  Provided  composablity  tools  to  OneSAF  program  office 
—  Developed  ontologies  for  describing  primitive  behavior 
metadata  and  composite  behaviors 
—  Demonstrated  software  tool  that  shows  how  composite 
behaviors  can  be  developed  in  the  future 


UNCLASSIFIED  Integrity  -  Service  -  Excellence 


In  FY04  we 

Improved  fidelity  and  accuracy  of  behavior  models  used  in  Joint  Warfare  Simulation  (JWARS) 

Commander  Behavior  Modeling  for  Command  and  Control  (CBMC2) 
created  more  realistic  decision  models  for  three  levels  of  command  in 
JWARS  (Incorporated  into  JWARS  1.6) 


DMSO  Human  Performance  program  is  ending 
DMSO  will  focus  on  standards  development 

Plan  to  transition  existing  programs  to  JFCOM  and  Service  laboratories 


